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ABSTRACT 

Various procedures, technologies, and products were 
developed by the Massachusetts Board of Regents and the Massachusetts 
community Colleges in implementing the student followup component of 
the Vocational Education Data System (VEDS). The Board of Regents 
took the lead in coordinating the VEDS followup study among the 15 
state-supported community colleges. A key feature of the followup 
study planning sessions was discussion about collecting useful 
information beyond the minimum required for the VEDS report An 
open-book database approach was adopted instead of minimal compliance 
with federal regulations. An operational analysis of the outcomes 
from the process included the organizational planning and structure 
that evolved from the groundwork for this project, the project 
products such as applications software, and operational difficulties 
encountered in implementing the project (content validity, 
confidentiality, and access). Data analyses were conducted at several 
different levels to produce reports for the federal government, state 
educational agencies, and the community colleges. (Selected aspects 
of these analyses are summarized.) (YLB) 
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The Vocational Education Data System (VEDS) is starting to 
become the major source of information for monitoring the 
impact of federal funds for vocational education under PL94-482 
and for assessing vocational education trends both nationally 
and at the state level. The present study reports on the 
procedures, technologies, and products that were developed by 
the Massachusetts Board of Regents and the Massachusetts 
Community Colleges in implementing the student follow-up 
component of the VEDS system. Outcomes are examined in terms 
of both operational and analytical results and the results thac 
would have been obtained by minimal compliance with federal 
regulations as compared to the open-book database approach 
adopted. 
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The Vocational Education Data System (VEDS) is starting to 
becone the major source of information for monitoring the 
impact of federal funds allocated tor vocational education 
under PL94-482 and for assessing vocational education trends 
both nationally and at the state level. Although the desire 
for such a data system or information source can be traced back 
to the Smith Hughes Act of 1916, VEDS did not become a reality 
to be dealt with until it was mandated as a system in the 
Vocational Education Reauthorization Act ot 1976. 

As is reasonably well-known, . andating VEDS as a required 
state and national level data system did not make the system an 
operational reality over night. The birthing of the system was 
far from smooth, as anyone associated with the process will 
attest to at length. By 1979, the national battle cry was "No 
VEDS for the Feds" and both Congress and the National Center 
for Educational Statistics who was charged with administering 
the system were hip-deep in hearings and testimony of one kind 
or another. 

The reasons for this reaction to the VEDS system are both 
numerous and complex and warrant investigation in their own 
right. Some of the reasons for this reaction, however, are 
relatively easy to identify and exemplary of lessons to be 
learned. 

First and foremost was the breadth and complexity 
(encyclopedic comprehensiveness) of the VEDS system and the 
attempts by NCES to bring the system on-line almost all at 
once. VEDS includes information at the program level on 
enrollments, personnel, finances, student outcomes and employer 
satisfaction by targeted populations and legislated 
categories. The jump to this breadth and level of complexity 
was simply too great of a quantum leap all at once. 
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The second major difficulty with the VEDS system was that 
it was totally silent on the processes and technologies by 
which the data required was to be produced. It has been 
maintained that this silence was a purposeful silance for a 
variety of reasons, but this position only side-steps the fact 
thai the processes and technologies for producing the data did 
not e-'iist nor had they been thought out in ar.y methodological 
detail. Further, when this particular problem and the data 
produc lion assumptions that were implicitly made by designers 
of VEDS were examined in detail by those who were charged with 
producing the data, it was found that implementing the types of 
technologies needed to produce the data meant radically 
disturbing the data production processes and technologies that 
were already in place at the institutions affected. The 
institution, therefore, not only had to create new technology 
and pi^ocesses but also had to redo its existing technology and 
processes. It was in this latter difficulty that the concept 
of burden came to be more clearly defined. 

The third major difficulty with the VEDS system was that 
the data it produced was only minimally useful to the 
institution ..ho v/as bearing the burden of data production. The 
reasons for this difficulty are again numerous and complex, but 
can be reduced to institucions being as interested in the "why" 
as the "whrt" of educational outcomes. 

The fourth major difficulty with the VEDS system was that 
it was a closed rather than open--book data system. VEDS is not 
particularly unique in this respect as almost ail educational 
databases at the macro level are currently closed-book systems. 
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VJhat is an open-book system? The open-book c pt says 
that those who produce the data and thosa who are u ected by 
the data and the decisions made from it must have access to the 
data, participate in the establishment of the database itself, 
and be able to analyze the data for themselves, nor just for 
their own uses and purposes, but also to prove to . nemssives 
the correctness of the analyses of others, or defeat these 
analyses empirically. 

Are closed-book databases a problem? Ask anyone in higher 
education about the Halstaad or Chambers reports or several 
other such reports, and you will not have to talk very much for 
the next few hours. VEDS , historically, was a late entry into 
a rapidly increasing population of closed-book databases, and 
this fact did not help this data system relative to getting a 
fair and objective examination by many of the constituencies it 
impacted. NCES , fortunately, began to recognize many of these 
problems early in 1980. 

All of the above difficulties with VEDS affected community 
colleges more severely than secondary schools. Beginning in 
1980, therefore, NCES began meeting with a National Committee 
of Community College representatives to see what could be done 
to remedy the problems with VEDS for community colleges. Inis 
committee met regularly for over a year and completely revamped 
the VEDS system to make it simpler, operationally implamentable , 
and more useful at the local level. 

Despite this cooperative work between NCES and the 
community college committee, the student follow-up component of 
the VEDS system remained problematic in a variety of ways but 
particularly relative to the processes and technology by which 
the data were to be produced and the usefulness of the data to 
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local institutions. Somewhat ironically, NOES, aftor initial 
reactions to the other components of the system, reducea the 
follow-up component of the system to 10 federally required 
items and 5 reports which severely reduced the utility and 
interpretability of the follow-up data even at the national 
level. Somewhat ironically again, much of the Community 
Colleges* Committee's work on the follow-up component was 
focused on expanding the follow-up component of the VEDS system 
so that it would produce more useful and interpretable data at 
both the local and national level. In the end, however, it was 
the reduced version of the VEDS follow-up component that 
prevailed with all of its incipient difficulies and problems. 

VEDS Follow-up 

'rne purpose of this paper is to report the procedures, 
technologies, and products that ware developed by the 
Massachusetts Board of Regents and the Massachusetts community 
colleges in implementing and conducting VEDS follow-up. xhese 
procedures, technologies, and products are generic and 
utilizable by other institutions and states and are somewhat 
exemplary in terms of what can happen when federal, state, and 
local professionals focus on working cooperatively to solve 
problems and achieve goals rather than upon solely getting 
their own individual needs met. Lastly, the results of the 
system-wide follow-up study conducted will be reported so that 
these results will not only be available to others but also so 
that they may be compared and contrasted with the results that 
would have been obtained if the path of minimum compliance with 
federal regulations had been chosen rather than the path 
described below. 
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Follow-up studies 

Follow-up studies can be an important source of information 
to assess the impact of an educational program or set of 
programs. Further, data generated from follow-up studies can 
also be used as input for institutional and systems planning. 
The problems associated with conducting follow-up studies, 
however, are not only numerous and complex but also compounded 
when one leaves the context of an individual institution and 
attempts to focus on sets of institutions. 

Forgetting their methodological short-comings, institutional 
follow-up studies tGnd to be very idiosyncratic which creates 
both comparability and interpretability problems not only 
between institutions but also for the same institution over 
time. This fact is coupled with an irony which is that 
institutions need the data from other institutions to make 
their data highly useful and interpretable. This irony leads 
to further problems of expense, coordination, cooperation, and 
needed technologies. The scale of these problems and the 
expense, however, is what keep institutions apart and operating 
idiosyncratically . A mandate requirement, therefore, is an 
external pressure that can act to overcome various impediments 
to systems development, particularly when there is a loss of 
funding associated with failing to satisfy the requirements. 
However, a mandate alone, it should be clearly noced, will not 
achieve the desired results and will in fact fail, as the 
history of VEDS has quite clearly shown. 

It was pressure from the VEDS requirements that pushed 
Massachusetts Community CollogGS as a group to the concept of 
regular rather than "one shot" follow-up studies. It was also 
the pressure of the VEDS requirements that made the colleges 
seriously consider standardizing their follow-up studies so 
that the data generated from the effort would have greater 
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utility and benefit for the cost and effort invested. 

Preliminary analyses of the problem indicated, however, 
that minimal compliance with the mandated VEDS follow-up 
requirements would not achieve the colleges* desired goals. 
The basic problem with the minimum VEDS requirements is that 
the minimum requirements produce a \racy limited data set of 
relatively low usability due to a lack of appropriate control 
variables and other information sets that are considered to be 
important by community colleges. 

'rne response of the Massachusetts Community Colleges to 
these various problems was to form a committee that would 
devise a follow-up form, model, and process that would not only 
remedy these shortcomings, but which also would satisfy the 
federal requirements in an efficient and cost-effective 
manner. Support for this committee and its work was obtained 
from both state officials and NCES. The Massachusetts 
Department of Occupational Education provided some cost-sharing 
seed funds to bring the project to completion, as the 
Department of Occupational Education and not the Massachusetts 
Board of Regents is the sole state agency for vocational 
education in Massachusetts. It should also be pointed out that 
although there was some conflict between these various 
agencies, all of these agencies strongly supported this project 
and its goals. This latter fact cannot be stressed too 
strongly, moreover, as it was critical to the success of this 
project. 

t'OLLOW-UP PLANNING 

As the agency designated by the state legislature to 
oversee the operation of all colleges and universities within 
Massachusetts, the Masschusetts Board of Regents took the lead 
in coordinating the VEDS follow-up study among the fifteen 
state-supported community colleges. A staff member of 
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each community college was designated as the college's V£DS 
Coordinator. These coordinators met with staff from the Board 
of Regents to plan the follow-up study and in particular to 
develop the content of the follow-up survey, which incorporated 
both federally required and localy desired information in one 
instrument. These coordinators also oversaw both one mailing 
of surveys to 1981 graduates and the preparation of a "student 
background" tape which was incorporated into the database 
during the data analysis phase of the project. 

A key feature of the follow-up study planning sessions was 
the Discussion among the. VEDS coordinators and Board of Regents 
staff about collecting information beyond the minimum required 
for the VEDS report which would be useful to the individual 
colleges and the Board of Regents. These discussions formed 
the basis for generating survey items and for identifying data 
which was critical and could be supplied by the college. xhe 
basic requirement for including particular items in the survey 
form was that the form be kept short, (i.e., no more than one 
page both .ides) and that the response to the item would 
provide information useful to a majority of the community 
colleges and/or the Board of Regents. Some of the additional 
items on the questionnaire concerned prior work experience, 
co-op education and other work experience during enrollment, 
achievement, age, mode of program completion, and transfer to 
other colleges, as a central objective of the project was to 
generate models which would causally describe short-term 
program outcomes. In the end, the survey form contained 30 
items with an additional 6 items provided by computer tapes. 

All of the schools agreed to send out the same form of the 
survey within a o.ie month interval, (February 1 to March 1, 
1983) . A cover letter describing the survey and a prestamped 
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return envelope were included with the questionnaire. I'ha 
cover letter was signed by the President of the college that 
each student attended. 'rhe completed surveys were mailed 
directly to the Board of Regents rather than to the individual 
colleges and the reasons for this mode of survey return was 
explained in the cover letter that was sent to the student. A 
total of 4,936 surveys were mailed to students who graduated 
from Career Programs conducted at Massachusetts Community 
Colleges in 1981. These 4,936 students were the universe of 
graduates from these programs. 

By having the completed surveys returned directly to the 
Board of Regents it was possible to ensure data integrity by 
establishing standardized coding procedures across the fifteen 
community colleges, and to maintain unit record data (i.e. 
individual survey responses) , rather than aggregate data only 
(i.e., totals by college), for use in data analysis. 
Furthermore, since the Board of Regents served as the central 
data analysis point, it was economically feasible to prepare 
software tailored specifically to the VEDS reporting 
requirements and local institutional reporting. 

Lastly, we did not do leaver follow-'Up nor employer 
follow-up as the States were exempted from these requirements 
for 1981 graduates. 

Results 

The outcomes from this project can be examined at two 
different levels: operational analysis and data analysis. The 
operational analysis includes the organizational planning and 
structure which evolved from the groundwork for this project. 
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the project products such as applications software, and 
operational difficulties encountered in implementing the 
proj^.ct. With regard to data analyses, project efforts havG 
been geared to producing reports for the Federal govaiament, 
state educational agencies and the 15 state-supported community 
colleges. A brief overview of the analyses included in these 
reports will be presented at the end of this paper. 

Ope rational Analyses 

While the central purpose of the follow-up project was to 
produce summary reports which would meet NCES requirements, 
this objective was embedded within two other objectives. The 
first of these two objectives was to develop a database and a 
data retrieval system which would enable diverse usc-rs to 
utilize the follow-up data for their own needs and the second 
objective was to create a cohesive planning network which 
encompasses the Board of Regents, the 15 community colleges, 
and other state and federal agencies. 

Given the need to balance the three objectives described 
above, careful "front-end" planning was essential. The 
"front-end" planning required, moreover, involved far more than 
just the design of the questionnaire and identification of the 
follow-up sample. 

Prior to data collection, detailed data coding procedures 
were established, and basic data processing needs vis-a-vis 
soft\7are development, computer time, and programmer time were 
identified. This detailed planning allowed us to allocate 
funds and staff for the project in an efficient manner. More 
importantly, this advanced planning made it possible to avoid 
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many design errors and to minimize the consequences of 
potential project difficulties and failures. 

A flow chart of basic project activities is presented in 
Figures 1 and 2 which are included at the end of this paper. 
An examination of the flowcharts will reveal that staffing 
needs vary during the course of the project. In general, 
project staff are responsible for five major tasks: a) overall 
design and management of the project; b) coding of incoming 
surveys; c) data entry; d) software development; and e) data 
analyses. During the early phases of the project the primary 
staff needs are for survey coders, keypunchers, and programmers 
but as the project progresses the need for coders and 
keypunchers decreases while the need for research analysts 
increases dramatically. 

The flow chart in Figure 2, it should oe noted, also 
contains "Hold" locations. These "Hold" locations are 
potential trouble spots which were identified prior to the 
start of data collection. By identifying these and other 
potential trouble spots it was possible to not only develop 
contingency plans but in some cases to dovetail contingency 
plans with the basic project plan in ways that could enhance 
the project at minimal cost or effort. In general, such 
planning is often referred to as parallel or simultaneous 
planning rather than serial or linear planning. Parallel 
planning was an important factor in the success of the project. 

A prime example of parallel planning in this project was 
our request for student information on computer tapes. The 
purpose of these computer tapes were (a) to fill in missing 
information (e.g. ethnic background) on returned surveys to 
make them usable for VEDS reports and (b) to gain associated 
control variable information for building a fuller data modal 
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than was generated or could be generated from the survey 
instrument alone. I'he computer tapes, therefore, ware a 
bacJc-up mechanism for surveys returned with missing data on key 
items and a method of accessing data that could not be readily 
obtained through tne survey instrument itself. These computer 
^3pes, however, also served as a back-up in another important 
way . 

Since tiiisj follow-up project was the first statewide survey 
of community college graduates, we had no way of estimating 
valid survey retam rates. Consequently, we decided to build 
in a plan for a second mailing in case the initial rate of 
returns was too low to produce meaningful results. While there 
ace numerous ways to condn-t a second mailing, we decided to 
code identifying information from the survey forms and to cross 
matcn the returned survey:^ with an original list o^ the 
anivcrse. Address labels for a second mailing could then be 
generated from tne remaining non-matches from th;^ universe 
1 i St J. 

Each community college sent a computerized list of the 
graduates' names, coded student identification numbers and home 
addresses. For chose colleges which had computerized their 
student records the-o was little additional cost to adding 
information auch as GPA or dat^^ of initial registration to 
choir mastBr list of the graduates* addresses, and each piece 
ot in^or^'^J^ion each college added to the tape increased the 
potential power of the study. Therefore, sound front-end 
planning enabled us to obtain additional student data which 
could bo used during the anal/iiis ^phase, even if it was not 
necesnary to conduct a secjnd mailing* 
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Another example of tha use of parallel planning was in the 
software development component of the project. One objective 
of the project was to develop an integrated set of applications 
software which could be used to produce accurate and 
appropriately formatted reports for NCES directly from the raw 
survey data. Software development, therefore, was built into 
the project plan in several different places (see Figures i and 
2). However, an alternative fallback route was also pursued. 
This fallback route was to use existing software packages 
(i.e., SPSS and Infofctch) to produce reports in a piecemeal 
fashion to complete the NCES report. 

Once again, parallel planning was not a wasted effort, 
since the results from the analyses from the prepackaged 
programs were used to verify the accuracy of the 
project-developed integrated software. Such cross-checking is 
not only standard operating procedure in software development, 
but is also the concept of concurrent validity in another 
form. Further, with minor modifications the prepackaged 
software programs were used for more sophisticated data 
analyses in the reports for the Regents, the Department of 
Occupational Education and local colleges. Once again, 
therefore, detailed and careful preplanning enabled project 
staff to dovetail safety-net procedures with ongoing project 
needs at little or no cost to the project. 

Software Development 

In many educational research projects software development 
does noc begin until the data have been collected and 
keypunched. In contrast to the typical project, a computer 
programmer was added to the staff prior to the coding and 



14 



-13- 



keypunching of the follow-up data. Discussions betwaen the 
programmer and other project staff were very important in 
determining how to code and keypunch the survey in the most 
efficient manner. 

For example^ wage data had to be reported in terms of 
sala ry per hour not including overtime . The wage related items 
on the survey allowed respondents to report the i r salary in 
terms of salary per hour , per week, par month, or per year . 
Not surprisingly respondents invented many other ways of 
reporting their salary, namely, per day, per two week interval, 
per job completed, per sale, and so on. The programmer pointed 
out that while software could be developed to handle just about 
any form of wage data input, given the wide variety and in some 
case?? idiosyncratic wage responses it would be most efficient 
to convert the reported wage into Ln hourly wage right at the 
time of coding the surveys. On the other hand some seemingly 
simple coding tasks could be handled most efficient!^' through 
the applications software. 

Another example of this point of including a programmer on 
the team early on in the project concerns the problem of 
identifying valid VEDS surveys. According to NCES reporting 
requirements, the only surveys which could be included in the 
database for VEDS reporting were those which were complete in 
terms of certain key items defined by NCES in their 
specifications of the VEDS follow-up system. However, since 
the key item set for determining a valid survey differed 
depending on the respondent's employment status, separating 
valid from invalid surveys was a difficult and complex 
problem. In this instance the programmer indicated that it 
would not be difficult to incorporate a generic selection 
criteria module into the applications software. By working in 
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tandem, therefore, project staff were able to optimize the 
survey coding and software production components of the project. 

Data Structures 

Given the above discussion about having a programmer 
interact with the research and development staff in the early 
phases of design, three key points need to be made. First, 
interaction with a programmer during the early phase of the 
project was only possible because the project staff adopted a 
data structures orientation at the outset of the project. 'rhe 
survey was not simply a list of items, it was a structured s^t 
of items with the structure being known and depicted explicitly 
in terms of its many different aspects and features. This 
explicit and detailed structure down to codes and file 
structures is what made the range of products developed, 
analyses conducted and productive interactions with the 
programmer possible. 

The second point of importance is that the explicit data 
structures approach enabled and brought about various 
evaluations and analyses of the survey itself relative to the 
detection of flaws and weaknesses prior to the survey being 
finalized. The data structures approach, therefore, is also a 
methodology of product evaluation as well as product design. 

The third point of importance is that an explicit data 
structures approach makes the instrument and study design 
itself highly transparent, as it did to the programmer who came 
to work with the research and development staff. Explicit 
structures and structuring, therefore, is both a necessary and 
critical feature of the open-book database concept. 
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Database Design 

As previously mentioned, the reporting requirements for 
VEDS could have been met without developing an integrated set 
of applications software. In contrast to the one-time data 
needs of the NCES, however, the open-book database concept 
required that the survey data be- entered into the database at 
the level of the unit-record and conversely to be accessible 
from the database on a unit-record basis. 

Instead of first producing the VEDS reports and then 
trying to create an open-book database system, it was most 
efficient to allocate funds right at the start of the project 
to developing the open-book database system in tandem with the 
VEDS reports. In the short run, incorporating the open-book 
concept right from the beginning required greater immediate 
expenditures and effort, but over the life of the data (not 
just the project) the costs for the open-book system will prove 
to be much less expensive on about a $5 to $1 basis. Start-up 
costs are relatively high in an open-book database system, but 
maintenance costs are very low and almost constant. When one 
factors in the power and quality of the data one has, however, 
versus the data one would have had by choosing the minimum 
response route, the cost/benefit ratrp difference between the 
two alternatives is a very large number. Some critics, 
moreover, have argued that the cost/benefit ratio for the 
minimum response route is a negative number, particularly at 
the local level. 

One of the ironies of the VEDS system is that it is 
implicitly unit-record driven on the front-end (i.e., the 
enrollment components) and table-dri veii on the back-end (i.e., 
the follow-up components). it is our belief and contention 
that the exact opposite design is needed for a minimal 
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system, as the follow-up components are final in character, 
more difficult to do operationally and mora difficult to 
analyze and interpret. Obviously, a unit-record system would 
be desirable throughout, but if one had to choose a table- 
driven front-end and a unit-record driven back-end would be the 
better choice, as we believe the analyses presented at the end 
of this paper will show. 

Computer Tapes 

Prior to this follow-up project the community collages had 
never submitted information to the Regents or any other agency 
we know of in a computer accessible format. The Regents staff, 
therefore, were somewhat unsure about the colleges' capability 
to provide the requested data according to specifications 
within the designated time-frame. As it turned out, these 
apprehensions were well-founded. 

Although very detailed tape descriptions, formats and 
standards were provided to the colleges, numerous problems were 
encountered with the computer tapes the colleges produced. The 
most common problem was the college's D.P. staff not following 
the tape descriptions, formats, and standards distributed and 
not providing the Regents staff with any documentation on how 
their tape differed from the tape requested and the standards 
distributed. 

Another problem with the background tapes concerned the 
accuracy and completeness of the data. Only two community 
colleges provided us with all of the information which we 
requested and there were a few colleges which were unable to 
provide us with anything more than the information necessary to 
produce a mailing label. This empirical result deviated 
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markedly from what we were told could be produced by managers 
and coordinators, and it is a fact that should be well noted. 

The reasons for the above results are somewhat complex and 
historical, but there is one point that is well worth noting. 
Unlike the programmer who did the VEDS and project programming , 
we did not include the DP Directors directly in the front-end 
phases of the project. This lack of inclusion was in part due 
to various expediencies associated with the time constraints 
imposed on the project in terms of reporting deadlines. It 
was, however, a mistake and one we are seeking to remedy in a 
variety of ways not only in terms of this project but also on a 
system-wide basis. In the end, each college did manage to 
produce a machine readable tape with at least mailing labels on 
the tape and we considered this outcome to be a major 
achievemepr in the piloting of this process. 

Content Validity 

The issue of the accuracy of the database has already been 
discussed but the issue of the validity of the database has 
only been discussed at the level of producing VEDS reports. As 
previously mentioned, selecting valid cases for VEDS reporting 
was a difficult and complex problem due to the key item set 
varying depending on the respondent's status on different 
items. Another validity problem, however, was encountered in 
the process of developing the full software system and this was 
a difficult problem that we did not anticipate. 

This second validity problem was that a survey which was 
apparently valid for the community college system as a whole 
was not always valid at the level of the individual community 
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college. To be more specific, graduates in the VfiDS data 
stream are classified according to a 6 digit Office of 
Education program code, (e.g., 14.0008 for secreterial 
science) . The integrated software for the VEDS reports was 
designed to eliminate any survey records with invalid program 
code numbers for the community college system as a whole based 
on Board of Regents approved degree programs. Given this point 
then, college A may logically have graduates from code 14.008 
while college B may not because college B does not have this 
program, as no such program has been approved for the college 
by the Board. 



Now, for the production of the VEDS reports a return from a 
graduate of college B with the program code 14.008 would have 
been considered a valid survey since that code nu.nber was 
included in the universe of degree programs reported previously 
to NCES in the Graduates/Leavers Report filed by the State. 
However, when we began to produce individual college reports, 
we found situations where there were surveys being returned 
from students who graduated from supposedly non-existent 
programs for particular colleges. 

'ihis result oDviously caused problems with the reports and 
the software and on several other factors as well. A variety 
of "reconciliation" modules, therefore, had to be added to the 
software (and elsewhere) to remedy this problem. Here again, 
many of the discrepancies were explicable and technically 
reconcilable but extremely tedious and time consuming in their 
resolution. 



Given the above points, our design error was focusing on 
the validity of the database on two levels only; namely, 
individual students and the total universe of programs. We did 
not sufficiently attend to validity issues at a third level> 
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namely, that of the individual colleges themselves. This 
intervening variable (namely, the individual colleges 
themselves) is a difficult one to deal with at every ]evel in 
the process from design to the analysis of the data. 
Nevertheless, maintaining data at the individual response level 
enabled us to rectify the problem fairly easily once it was 
discovered and we are now building this control feature into 
the system. 

Confidentiality 

The process of making the data available to users beyond 
the Regents staff and participating colleges is now beginning 
to confront' us, as the power of the project and the data it 
generated begins to take hold. One problem associated with the 
creation of an open-book database is ensuring confidentiality. 
In general, absolute confidentiality is impossible whenever any 
identifying information is available. Therefore, while it 
would be impossible to identify an individual graduate directly 
from our data base, an individual who had access to a list of 
graduates from a particular college which included degree 
program, sex, age, ethnic status, and special needs, could with 
the aid of a computer identify some of the individuals in the 
database, if only probabilistically. Obviously, the only 
person in the world who would go to such lengtns to identify 
graduates in this manner would be the college's Alumnae Giving 
Director. However, since mass mailing would be a far more 
cost-efficient strategy, we doubt that even the Director of 
Alumnae Giving would go to such lengths to identify particular 
individuals. 

Since there is actually very little data in our follow-up 
survey that is truly confidential, the confidentiality issue is 
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a somewhat moot ons in this case. However, the confidentiality 
of the data needs to be insured, and can be insured, and the 
reader is referred to several publications for descriptions of 
the technologies that are available to achieve such protections 
(e.g., Boruch, 1972, Helman, 1979, Carifio and Biron, 1979). 

Access 

An open-book database requires special efforts to ensure 
respondent confidentiality. However, special efforts are also 
required to ensure user accessibility. Providing detailed 
documentation and accessibility to the database and available 
software is essential for a viable open-book database system. 
Developing adequate documentation, however, takes a 
considerable amount of time, particularly if one is trying to 
make the database available to individuals who may not be 
sophisticated computer users. Providing training in ways to 
accecs and use the existing database and software is also a 
required component of a complete open-book system, even with 
sophisticated users. Lastly, there are a number of convenience 
items that need to be developed which help users in a variety 
of ways and these convenience items will be described more 
fully in the next section of this paper. 

Open-Book Database Products Developed 

Five major database products were developed in carrying out 
this project. To meet the primary objectives of the project, a 
set of integrated software applications packages were developed 
to produce the required VEDS reports. Samples of the computer 
printouts that were generated for the VEDS reports are 
presented at the end of this paper. Once the data has been 
keypunched, entered into the computer and reformatted, the 
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entire five part report can be generated with a one line 
command from an interactive computer terminal. 

In addition to the overall VEDS report, each community 
college was sent similar reports which were limited to che 
graduates from their particular college. These customised 
reports allowed the colleges to compare their graduates with 
the overall statewide totals on a program by program basis. 
Alternative formats for summarizing the data were also used to 
provide each individual community college with readily usable 
information. For example, wage data in the VEDS report was 
reported only for those graduates who ware working full time in 
a field related to their training. We prepared college by ' 
college wage data for graduates employed both full time and 
part-time in their field of training and a similar breakdown 
for graduates who had jobs in fields not directly related to 
thair training. An excerpt of one of these community college 
printouts is presented at the end of this paper. 

Another project product was a floppy diskette which 
contained all of the project's and database's documentation and 
all the data analyses which were included in the reports 
generated for the state level agencies. In this way, all of 
the documentation and the data analyses could be made readily 
available to anyone with the appropriate hardware. In our case 
the diskettes were generated for a Wang word processing 
system. 

Since each of our community colleges has their own Wang 
system, these diskettes allowed us to disseminate results 
quickly, and to put the results on a look-up basis at each 
college. In addition to being able to view the data on 
diskettes, the diskettes were prepared in word processing 
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format so individual schools could create typed copies of any 
tuble whenever it was needed. These same points also held for 
the project's and the database's documentation. Not only a 
great deal of paper was eliminated in this way, but also a 
great deal of hunting through hard copy files by people 
searching for information. 

Three other products have also been developed in order to 
maximize the ut ilizability of the raw data collected for this 
project. On-line accessibility to the raw data and the 
analytical software have been provided to each of the community 
colleges. At the unit record level, all identifying 
information has been deleted but a user can still analyse the 
data in a myriad of ways. In addition to the raw data, 
open-ended statistical analysis and report generator software 
(SPSS and Infofetch files) arc- also available to any user of 
the c'ata and not just our 15 community college users. 

We have already had requests for access to our data by two 
doctoral students at local universities and we are currently 
working out access agreements with both of these doctoral 
students. As we are replicating and expanding our efforts, we 
believe that our database will become more and more interesting 
with time to a wide variety of people. Finally, documentation 
in both hard copy and diskette form is available so that the 
project itself can be replicated and interested users can 
access existing data for their own rssearch or program planning 
needs. All of the VEDS reporting software programs are, 
moreover, in COBOL which makes them reasonably transportable to 
a variety of machines. 
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Data Analyses 

As previously mentioned, the data analyses for this project 
were conducted at several different levels. Selected aspects 
of these analyses will be summarized below, as a full reporting 
of results is simply beyond the scope of the present paper. 

Of the 4,936 1981 Career Program graduates, 1,367 128%) 
returned surveys which were valid in terms of the VEDS 
reporting requirements'""- Overall, only 54 (4-9%) of the 1367 
graduates who responded to the surveys were unemployed and not 
attending school, in the military, or not in the labor force- 
This result is far below the State (7-9%J and the national 
(10-1%) averages for rate of unemployment at the time the 
survey was conducted. 

In terms of the remaining responders, 897 (65-6%) were 
employed in a field related to their training, 137 {10.21) were 
employed in a field not related to their training, 243 (17-7%) 
were pursuing additional education, 32 (2-5%) were not in the 
labor force (e.g., stay-at-home spouses), and one was in 
full-time military service. When the data were analyzed to 
include students who were employed full-time and going to 
school, 506 (37%) of the graduates who responded to the survey 
were pursuing additional education. 



I In total there were 1,652 surveys returned which 
constituted 33.5% for the career program graduates from tne 
community colleges. A 17.2% loss rate, therefore, occurred in 
terms of surveys that did not meet NCES validity requirements. 
The analyses presented here have been confined to VEDS valid 
surveys. A second mailing was not done due to the response 
rates obtained and the constraints of reporting deadlines. 



er|c 25 



-24- 



Among those students who were logically eligible for 
fu]I-time employment, 897 (70.2%) were employed in a job 
directly related to thair training. The bulk (65%) of the 137 
graduates who were employed in fields not related to their 
training were from Police and Fire Science Programs and 
administrative and secreterial programs. This latter outcome 
seemed to be logical in terms of both Massachusetts' 
Proposition 2-1/2 which limited local taxes and the state's 
overall economy which was in a business down turn at the time 
of this survey . 

Finally, for those graduates who were employed in their 
field of training, the average hourly wage for malGS was $8.53 
per hour, while the averago hourly wage for females was $6.88. 
The average wage ranged from $3.93 per hour to $14.00 per 
hour. These average hourly wage statistics are significantly 
above the averages for the state. 

These results in terms of unamployment levels, levels of 
employment in fields related to training and average hourly 
rate are excellent, particularly isince they are averages across 
roughly 45 different degree programs conducted at 15 colleges 
spread across the state. The problem with these findings, 
however, is that do not know whether the results would be 
this good if the missing 72% of the graduates (i.e., the 
non-responders) were included in the database, and this is why 
we are proceeding very cautiously with these findings at this 
point in time. Further, the results that were observed for the 
Police and Fire Science Programs and the administrative and 
secretarial programs clearly indicate that there are some 
significant interactions in the data that must be considered in 
the interpretation of outcomes. We have explored some of these 
interactions and they clearly indicate that one must be very 
careful in interpreting the data in several different ways. 
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At the macro level (all graduates and all programs) , the 
rink ocJor ot stop-wioc multiple regression effects were Age, 
Generic Program Area, Sex, College Location (Urban versus 
HurOiDr and Graduate: Rating of Quality of Job Preparation. 
Ihe significance of those variables decrea^^e in rank order by 
.^bout haL£ beginning with Age which had an F-ratio of 77.6. 
Vhe interactions of these five variables account for about 24% 
of the variance observed in hourly wage, degree of job 
relatr^dness to training, rating of the quality ot job 
pt op *i-ation, the pursuit of additional education and a number 
of otho^r variables. Some of the basic reasons for these 
effects can be seen from Table I which presents age 
distributions by macro program areas. 

As can be seen from Table 1, graduates are not distributed 
evenly across macro program a'.oas. Graduates are concentrated 
in the Business/So'^reterial (12%), Health (28%), and 
lechnoiogies (21%,> areas. More significant, however, is the 
fact that age of graduates is both distributed and concentrated 
ac the same time. 

As cap be seen from Table 1, community college career 
progratm graduates range m ages from 20 to over 56 years old. 
Over 35% of the career program graduates in the sample were 
over 28 years old at the time the survey data were collected. 
Vhe majority of older students (37 or greater) , nowever, are 
concentrated in the Health and Technology areas. Similar 
distributions ani concentrations, moreover, were also found for 
sex and prior work experience. Ihe nature of the macro 
interactions found in the data, therefore, were nested 
step-wise within factors. 

In general, older men and women (37 or greater) were more 
concentrated in Health and Technology programs than they were 
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Table 1 

AGE GROUP BY DEGREE PROGRAM AREA 
Age Group Degree Program 

Agriculture Service Medical Child Care/ Secretary Technology Production/ Total 
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Table 2 
AGE GROUP BY GRADUATE'S SEX 



Age Group Sex 

Female Male Totals 
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Table 3 



GRADUATE'S SEX BY DEGREE PROGRAM AREA 
iSi Degree Progfam 
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in other programs. Younger women (less than 23) were more 
concentrated in Business and Service programs. In general/ 
salaries were higher in Health and Technology programs and 
higher in urban rather than rural areas. Employment in a 
training related area was greater in the Health and Technology 
field and greater in urban rather than rural areas, 
particularly for older graduates. Neglecting Police and Fire 
Science graduates, young women in non-health and non-technical 
fields were employed mostly in jobs unrelated to their training 
at comparatively lower wages. These women also tended to be 
pursuing additional part-time education. 

Over 80% of the community college graduates had work 
experience prior to entering their program, with about 62% of 
the graduates having had prior work experience in their current 
area of training. Over 70% of the graduates worked while 
attending their program in some form. Neither prior work 
experience nor working during training, however, directly 
predicted employment status, hourly wage, degree of job 
relatedness or other factors in step-wise multiple regressions 
when the basic macro factors of Age, Sex, and macro Program 
Area were included in the equations. The work experience 
variables, therefore, were primarily statistical surrogates for 
Age, Sex, and Macro Program Area which are themselves 
statistical surrogates for other complexes of variables. 
Nevertheless, it is quite clear from the analyses conducted 
that the 1981 graduate population was quite heterogeneous in 
character witn at least three significant subpopulations 
embedded within it. Further, it was also quite clear from the 
analyses conducted that many of the systems programs were being 
utilized for upward mobility and career shifting purposes. 

What one sees from these results is that both macro and 
micro program outcomes are a function of several complex 
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processes and that uncontrolled comparisons between programs 
(and/or colleges) and outcomes would most likely be quite 
spurious. A number of potential differences between 
populations, programs, and colleges must be taken into account 
in assessing and interpreting all outcomes, as our macro 
analyses indicate''". 

We fully recogniz that our macro models are currently 
exploratory and extremely broad-guaged , particularly in terms 
of college, person, and program characteristics. We are also 
quite aware that our macro analyses indicate that micro models 
of the data need to developed which analyze the data 
separately by sex, age group, program area, location and 
several other factors. Further, we recognize that micro models 
of the data may be more highly informative, particularly to 
individual colleges in terms of examining the constellation of 
programs they offer in terms of the various macro factors that 
we have identified. We are presently moving in these 
analytical directions and our planned replication of this study 
within 1982 graduates should help us considerably in these 
various analytical activities. 



1 Preliminary analyses indicated that older graduates tended 
to return the survey, whereas younger graduates did not. This 
return rate bias accounts for the size of some of the 
percentages of totals on certain variables but does not 
significantly impact the basic nature of the structural 
findings. In the worst of all possible cases, the age findings 
would only be diminished somewhat in magnitude if the entire 
population returned the survey. Given the size of the effects, 
age would still be the first variable stepped out in the 
regressions and it would still be the most powerful predictor 
by at least two orders of magnitude. 
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Conclusions 

Obviously, there are a plethora of conclusions that may be 
drawn from our project at a variety of different levels. 
Although many of these conclusions are rather ironical, we 
would like to focus on those that may not at first be apparent 
to readers unfamiliar with this area. 

First, the Vocational Education Data System (VEDS) was an 
historical event of great importance that should be carefully 
studied in a variety of ways for what it can teach us about 
macro data systems. The VEDS participants have the 
historiographical data that is needed for clarifying critical 
concepts, values and issues in this area. It is vital, 
moreover, that such clarification processes occur, so that we 
can move to newer levels of conceptualization and understanding 
in a reasonably short period of time. Many facets of the 
problems in this area have been chronically persistent for over 
70 years. 

The next point of importance is that there is a tremendous 
amount of human systems building and technical work that must 
be done and in place prior to initiating a project like the one 
reported on here. One should not even attempt this kind of 
project, moreover, without this necessary predevelopment . In 
one form or another, preparation for this project was done in 
fits and starts over a three year period, and it was the end of 
the 5 year authorization period of PL94-482 and the need for 
compliance for reauthorization that brought this project to 
fruition in a rapid time frame. If we had not done the 
predevelopment work, and if there had not been an incipient 
system in place, we would not have been as successful as we 
were. 



o 35 
ERIC 



•29- 



The next point of importance concerns our choice of the 
non-minimum compliance route in responding to the VEDS 
requirements and the open-book database system we put in place 
through this choice. Given the macro analyses presented, one 
should not be surprised that the average hourly wage rates of 
1981 community college graduates in Massachusetts were 
significantly above the state or, for that matter, the national 
average. xhese relatively high wage rates are readily 
explicable, but not from the VEDS minimally required data set, 
or in terms of factors that one might have attributed these 
fundings to if one did not have the advantage of the database 
we developed. Our rationale for exceeding the minimum 
requirements of VEDS was to put in place a system that would be 
capable of carrying out such analyses on a routine basis. 
Another reason for creating this kind of system, moreover, is 
that the post-secondary world is vastly different from the 
secondary world and macro system designers need to be aware of 
this basic fact. 

Lastly, we believe that we have learned from che process 

that the open-book database concept is a strong, vibrant, 

dynamic, and powerful concept that will probably be a common 
wisdom concept by the end of the eighties. 
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Sample VEDS Report 



ERJC 



STATE ►'iSSHCHUSETTS PEPOPTINR PF'tPO IQP? mo ^lUicrTip^py 

, "APT OICnuTinii ICONPIETEP^ ONLY) c[f|.p qp fMPLnvMENl m ;w[Uf.E HfiijPiY 34i4fv '"^ tM-Tcrncmi ^rnPi^ 

, -...-—......,....„............... 

i I 'SECTION I nccin'iiin.'jii fieii) of chppent EHPinvcn inNipiifm isiciiiiN u iskH'N hi 

'\ ! H'li)4r ! •<i.>t 

/ MWM;A^-44i>IOlWM4ai^4flk4t4W5■l■P■^CAJIn^l IWA .:4UC,n2Y . L-iiUli Y ♦....!. . 

TNSTRUCTIOHU PfiOGJAH . . I 511 5^1 sm„..^h 57 I 5B I 61 I'.i-^V ^' ' /r i ^? !NLl FfHALEif'AU FEriu 

1 01,0100 *GPICUlTUR4l PPP0UCTinN 0 fl .. 0 0 0 0 0 0 0 0 r"T""(ir3"6 

1 01.0200 4GPKUITUR41 SUPPi IES/SFRVICE5 0 0 0 0 0 0 0 0 n r. n 0 .CO on y 0 

|-0h WOO ACPICULTU n u wcc i umcs 9 0 ^ P 0 fl ^ Q n n n n . p o Jou 0 0 

01.0400 AGRICUlTUPil PBDOUCTS 0 0 0 0 0 0 0 " (i 0 0 o .('0 oo " J " o' 

01,0500 HORTICIIITUPF 0 1 0 ■ 3 0 0 0 n 0 0 0 I ^.q? un ? > 

01.0600 PFNFVABLE NiTUPU pESOUPCES C 0 0 0 0 0 0 1 0 0 0 0 .CO 00 0 0 

01,0700 FOR£ST»Y.-.~ - 0 0 -0 fl. 0 0 0 n n 0 0 0 .00 0 0 

01.9900 OTHEP iGPlCULTUPE 0 0 0 0 0 0 0 1 0 0 0 .00 .00 0 0 

O^OIOM O VEB TISI H C S E P VKCS P 0 0 0 0 0 0 £L. 0 a . Cl _0 ^Dd-JO 0 U 

04,0200 mHPEl AND ACCESSORIES 0 1 0 0 0 0 0 0 0 c f 0 .(lO ;,Vj U ' l" 

04,0?00 JUT010BILE-. C 0 0 0 0 0 0 0 0 0 D 0 .00 .00 0 0 

04.0400 FIKANCE AND C»EDIT 0 0 0 C 0 0 0 n fi 0 p 0 .CO 00 0 0 

04.0500 FLOPISTPlf 0 0 .0 0 0 0 0 0 n 0 0 D .00 '.00 0 0 

04.0600 FOOD OISTPIPJ^^ION 0 0 0 0 0 0 0 " 0 0 0 D .00 .00 0 0 

Q M700 rono st u victi ; e — ? — o — o — o — q — o — j) n o,... ..t.. i 6.?o ^.33 4 j 

04,0e00 GENERAL HEPCHANOISE 0 0 0 0 0 0 0 n n r p ] ..j^ ^ ,q~ ( '"■V 

04.0900 HAPOWAPFf RUIIOING HiTEPIAL. E 0 0 0 0 0 0 0 0 0 n o 0 " 00 'ou 0 0 

04,1000 HOHE FURNISHINGS 0 0 0 0 0 0 0 n p 0 0 !oo *00 0 0 

04,1100 HOTEL AND LODGING 0 4 o p o 0 0 0 (i o o 1 6.^,1 !ofl <i 0 

04,1200 INOUJTPIAl fAPKETING 0 0 0 n c 0 0 ^ n o p o .(C 00 j 0 

i^^Tl^OHNWWNtf .-0 — ^1 0. 0 CL-... 0 G D 0 Q !oO j 0 

04,1500 PERSONAL SERVICES 0 0 0 0 O 0 0 i ( ^ ,^ .( , ,jn j 

04,1700 REAL ESTATE 0 0 0 0 0 0 0 i o r o u 'cc 'jj c n 

04,1800 RECREATION AND TOURISN 0 0 0 0 0, 0 0 " ^ r ( i //p ,,53 , . 

04.1900 TRANSPORTATION C 0 0 0 0 0 0 0 o fi c 0 'cO 'oo J 0 

04.2000' OTHER RETAIL TRADES 0 0 0 0 0 0 0 " C 0 u Cu 00 0 0 

04,99 00 OTH E R S!S ^ ^»UT1V E EDUC A im N e (i p ij 0 0 q O.-- (i . 0 n n .p n .'jp n _n' 

07.0101 OENTAUSSISTING ■ 1 1 0 0 0 0 0 0 n 0 0 0 .00 bM 0 

07.0102 OEHTIl HYGIENE USS0CUT6 DEGP 0 0 0 0 0 0 0 0 0 0 0 0 CO I' 03 0 16 

07.0103 DENTU LABORATORY TECHNGLOGY 0 0 0 0 0 0 0 0 n ] 0 0 'co 5*56 0 ; 
07,0203 NEDICAL LABORATORY ASSISTING 0 0 0 0 0 0 0 0 0 0 0 0 Ul b'h 8 
07,0299 OTHER MEDICAL LABORATORY TECHN 0 0 0 0 0 0 0 0 0 0 0 0 'cO 'ou 0 a 

07.0301 HU R St N C ( A SSOCI A T E OECBf H 0 0— -0 0 n n p ^ fl n n n o^c u'l^ w , im 

07.0302 PRACTICAL (VOCATIONAL! NURSING 0 0 0 0 0 0 0 0 p p 0 0 CO 00 0 ^0 

07.0303 NURSING ASSISTANCE (AIOEI 0 0 0 0 fl 0 0 0 0 0 0 0. .'oo !o0 0 0 

♦ IN SECTION IlrONlY INCLUDE S4H»IES Fqp FULL-TIHF FMPIOYI-FNT IN A FIFLO RFHTEO TR 1HW%, 

HCES FORH '404A-7, PAGE 12 OF 19 iHis OE'TT !<: jinnnji^fo by pl 94.41)2 |J0 'JSC 2391) 
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Sample VEDS Report 



■SitW? 



SiLi'V STUDr 



— PASS .. 5 



SCHOOL 



EHPLDYHENT ST»TUS 



DATE 8/11/83 

S4URY 5iT* 

" "ANGE SliNOARO 

Nn. NIN MM HEAN DEVIATID 



070103 OENTAl IJunHTOPY TECHNGLOGY 



*(IOOLESEK 



fULL-TIHE IN FIELD OF rSAINING 
FULL-TIHE NOT IN FIELD OF TP4IN|Nr, 
I^AHT-TIME IN FIELD OF TRAINING 
PAST-TIME NOT IN FIELD OF TPAHING 
-♦♦♦♦♦♦ SCHOOL TOTAL! i ***MM 



070103 OfHTAl UBPPATOPY TFCMNOLOr-Y 



♦ALL SCHOOLS^ FULl-TIHE IN FIELD OF TPATNJNG 

FULL-TIHE NOT IN FIELD OF TPAINIHG 

PAST-TIHE IN-flElO OF TPAININ5 

»APT-TIHE NOT IN FIELD OF TP41NING 



070203 HEOKAtiARORATOPY ASSISTING 



BRISTOL FULt-TINE IN FIELD OF TRAINING 

FULL-TIHE NOT IN FIELD OF TRUNING 
"APT-TINE IN FIELD OF TRAINING 
PAPT-TIHE NOT IN FIELD OF TRAINING 

♦♦ ♦ ♦ ♦ ♦ SCHOOL T0TAL5 * ^^»*** 



070?03 HFOK-»t-tAWPAT0PY ASSISTING 



070203 H«ieAl lA«OPATOPY ASSISTING 



MASS BAY FULL-TIHE IH FIELD DF TRAINING 

FULL-TIHE NOT IN FIELD OF TRAINING 
"APT-TIHE IN FIELD OF TRAINING 
PAPT-TIHE NOT IN FIELD OF TPAINTNr, 

• ♦♦♦♦♦♦SCHOOL TOT A LS*»**M* — 

HIOOIESEK FULL-TIHE IN FIELD OF TRAINING 

FULL-TIME NOT IN FIELD OF TRAIi^ING D 
'ART-TIHE IN FIELD OF TRAINING 0 
PAPT-TIHE NOT IN FIELD OF TRAINING 0 

♦♦♦♦♦♦SCHOOL TDT A LS^^***** i~ 



».}0 
0,00 
-0,00 
5.68 



5,1 6 J 
0,00 
0.00 
5.66 



4rW M 



}.$6 



-4t*0- 



5.50 S.63 
0.00 0.00 
0.00 0.00 
5.68 5.66 
-4tW 5tW- 



5.56 



5.68 
4^- 



6.00 7.27 

0.00 0.00 
0,00 «.oo 

0.00 0.00 

-MO — w;- 



6.63 



-M3- 



8,80 
0.00 
7,50 
0.00 
-7,W- 

7.20 
0.00 
0.00 
0.00 
4tW- 



6.80 
0.00 
7.50 
0.00 
■-4,80 ■ 

7.66 
0.00 
0.00 
0.00 
7 . 6 6 



6.80 
7.50 

■8,15-- 
7,43 

4vM- 



070203 HfBKAt-LAflORATOPY ASSISTING 



NORTH SHORE FULL-TIHE IN FIELD OF TRAINING I 9.J6 9.36 

FULL-TIHE NOT IN FIELD OF TRAINING 0 0.00 0.00 

PART-TIHE IN FIELD OF TRAINING 0 0.00 0.00 

»APT-TIHE NOT IN FIELD OF TPAINING 0 0.00 0.00 

♦♦♦♦♦♦5C H0 DL~T0T A LS«m^t* .. \ 9. a t ^j t 



9.36 



070203 MEDICAL LABOPATOPY ASSISTING 



SPRINGFIELD FULL-TIHE IN FIELD OF TRAINING 4 5,00 

FULL-TIHE NOT IN FIELD OF TRAINING 0 0.00 
PAPT-TIHE IN FIELD OF TRAINING 0 0.00 

PAST-TIHE NOT IN FIELD OF TRUNING 0 0.00 

mm€««MWt5**M»4U /, ;.o o 



7,37 
O.OD 
0.00 
0,00 

4rW- 



-<W«- 



6.07 



„ 070203 MEDICAL LABQRATOPY ASSISTING 



♦ALL SCHOOLS^ FULL-TIHE IN FIELD OF TRAINING 

FULL-TIHE :^nT IN FIELD OF TPAINING 
PAPT-TIHE IN FIELD OF TRAINING 
PAPT-TIHE NOT IN FIELD OF TRAINING 

■ ♦♦^wWfrAMOTALS****^* 



10 
D 
I 
0 

-H- 



»,00- 
0.00 
7,50. 
0,00 

-*tM- 



-iJ,J6 
0.00 
7.50 

0.00 



-7.06 
7.50 
440- 
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